Talent Groups hiring Data Engineer in United States | LinkedIn

Mandatory Skills: Spark, Scala, Kafka, AWS, SQL

Job Description:

Responsibilities:

• Develop and optimize data pipelines using Apache Spark and Scala.
• Implement real-time streaming solutions with Apache Kafka.
• Manage and deploy solutions on AWS (e.g., S3, EC2, Redshift).
• Write complex SQL queries for data transformation and ETL processes.
• Collaborate with cross-functional teams to ensure data system efficiency and scalability.

Required Skills:

• Proficiency in Apache Spark and Scala.
• Experience with Kafka and real-time data streaming.
• Strong knowledge of AWS (e.g., S3, EC2, Redshift).
• Advanced SQL skills for complex data queries.
• Experience with ETL processes and big data tools.